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IMAGE DISPLAY METHOD AND IMAGE DISPLAY DEVICE 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

[0001] The present invention relates to an image display method and an image 
display device capable of displaying real images or computer graphic images by providing a 
sense of actuality or reality thereto. 

2. Description of Related Art 

[0002] A wide viewing angle range must be obtained to display realistic images. 
The size of a display screen must increase to display realistic images when using related art 
image display devices having a cathode ray tube (hereinafter "CRT") display screens or liquid 
crystal display screens, and more particularly, an image display device to display the images 
by projecting them on a projection surface of a projector. As a result, the price of the image 
display device increases, a large space is required for projecting images, and power 
consumption increases due to the wide viewing angle range. 

[0003] In addition, when three-dimensional image data, such as computer graphic 
images are displayed on a two-dimensional plane display screen, they are generally displayed 
by using various projection methods, such as oblique projection, isometric projection and 
one-, two- or three-point perspective methods. However, these methods have various defects. 
For example, the displayed images are unnatural because the three-dimensional images are 
displayed on the two-dimensional display screen. 

[0004] The related art also includes methods of displaying images on a plurality of 
surfaces to display realistic images. For example, Japanese Unexamined Patent Application 
Publication No. 7-253773 discloses a three-dimensional display device. 

[0005] This related art method displays images on outer surfaces of a polyhedron, 
for example, a cube, namely it displays images by detecting viewpoints of a user, calculates 
how an object will be viewed from each viewpoint. 

[0006] Accordingly, the images can be displayed with reality as if the user saw the 
object in various angles. That is, more realistic and actual images can be displayed. 

SUMMARY OF THE INVENTION 

[0007] However, the related art must detect viewpoints of a user and calculate 
images from each viewpoint in real time. As a result, there are problems in that operations 
are complicated, and an operation device having high processing capability is required. 
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[0008] In addition, in the related art, the images are seen from the viewpoints of the 
user as if an object existed in a certain size cube. Since the images are displayed on each 
outer surface of the cube, a size of the viewing angle range is restricted by a size of the cube. 
If the cube is excessively enlarged to make the viewing angle range wider, the surfaces of the 
cube are so large that the user can see only one surface. This means that characteristics of the 
three-dimensional image display device, including a polyhedron, are lost. 

[0009] The present invention provides an image display method and image display 
device capable of obtaining a wide viewing angle range and a cubic effect, the display images 
are realistic, and naturally display real images as well as 3 DCG images even using a small 
screen. 

[0010] In order to address or achieve the above, the present invention provides an 
image display method to display images on a plurality of display surfaces by using a plurality 
of inner surfaces of a polyhedron as the display surfaces, the image display method 
comprising: calculating how images are displayed on each of the display surfaces when 
viewing the images to be displayed from a specific viewpoint; and displaying the calculated 
images on each of the display surfaces. 

[0011] According to the image display method, in the calculating of how the images 
are displayed on each of the display surfaces when viewing the images to be displayed from 
the specific viewpoint, if the images to be displayed are real images, then transforming the 
real images projected on a two-dimensional display surface onto at least two adjacent display 
surfaces of the plurality of display surfaces forming the polyhedron. 

[0012] According to the image display method, in the calculating of how the images 
are displayed on each of the display surfaces when viewing the images to be displayed from 
the specific viewpoint, generating three-dimensional computer graphic images, by dividing 
the three-dimensional computer graphic images in accordance with the at least two adjacent 
display surfaces of the plurality of display surfaces forming the polyhedron; and displaying 
the divided image data by using a perspective method having one vanishing point for each 
display surface. 

[0013] According to the image display method, the at least two adjacent display 
surfaces of the plurality of surfaces forming the polyhedron are orthogonal to each other. 

[0014] According to the image display method, the at least two adjacent display 
surfaces, which are orthogonal to each other, include a combination of vertical display 
surfaces and horizontal display surfaces. 
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[0015] According to the image display method, the displaying of the images on the 
plurality of display surfaces, uses as display screens, image display screens of an image 
display device having an image display function, and displays the images on the plurality of 
display surfaces using the image display screens of the image display device. 

[0016] According to the image display method, the displaying the images on the 
plurality of display surfaces uses at least one image display device for projecting the images 
on image projection surfaces, and displays the images on the plurality of display surfaces by 
the at least one image display device, the image display device using the display surfaces as 
the image projection surfaces. 

[0017] According to the image display method, forming the polyhedron in a box 
shape, the inner surfaces of the box are used as the display surfaces, and forming an inner 
viewing window, to view the inside of the box, in the box, and the specific viewpoint is set in 
the inner viewing window. 

[0018] An image display device according to the present invention is an image 
display device to display images on a plurality of display surfaces by using a plurality of inner 
surfaces of a polyhedron as the display surfaces, the image display device including: an image 
processing device to calculate how images are displayed on each of the display surfaces when 
viewing the images to be displayed from a specific viewpoint; and image display device to 
display the images obtained by the image processing device on each of the display surfaces. 

[0019] According to the image display device, if the images to be displayed are real 
images, the image processing device transforming the real images projected on a two- 
dimensional display surface onto at least two adjacent display surfaces of the plurality of 
display surfaces forming the polyhedron. 

[0020] According to the image display device, if the images are three-dimensional 
computer graphic images, the image processing device dividing the three-dimensional 
computer graphic images in accordance with the at least two adjacent display surfaces of the 
plurality of display surfaces forming the polyhedron, and generating images to display the 
divided image data by using a perspective method having one vanishing point on each display 
surface. 

[0021] According to the image display device, at least two adjacent display surfaces 
of the plurality of surfaces forming the polyhedron are orthogonal to each other. 
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[0022] According to the image display device, the at least two adjacent display 
surfaces orthogonal to each other comprise combinations of vertical display surfaces and 
horizontal display surfaces. 

[0023] According to the image display device, the images are displayed on the 
plurality of display surfaces by image display screens of the image display device and the 
image display screens of the image display device having an image display function are used 
as display screens. 

[0024] According to the image display device, the images are displayed on the 
plurality of the display surfaces by using at least one image display device, and the at least 
one image display device projecting the images on image projection surfaces by using the 
display surfaces as the image projection surfaces. 

[0025] According to the image display device, the polyhedron is formed in a box 
shape, the inner surfaces of the box are used as the display surfaces, an inner viewing window 
to view the inside of the box is formed in the box, and a specific viewpoint is set in the inner 
viewing window. 

[0026] The present invention provides an image display method to display images 
on the plurality of display surfaces which are inner surfaces of the polyhedron, calculates how 
the images will be displayed on each display surface when seen from the specific viewpoint, 
and displays the obtained images on each display surface. Therefore, a wide viewing angle 
range and a cubic effect can be obtained even on small display surfaces, and the images can 
be realistically displayed and consistently connected to each other on each display surface. 

[0027] In accordance with the present invention, the real images such as DVD can 
be realistically displayed by obtaining a wide viewing angle range and a cubic effect on small 
display surfaces. In addition, three-dimensional computer graphic images can be displayed on 
small display surfaces with natural vanishing points like a real object. They can be also 
displayed with a wide viewing angle range and a cubic effect. Even if the viewpoint of the 
user changes, the images is displayed with natural perspective without revealing any 
incongruity. 

[0028] At least two adjacent display surfaces of the plurality of display surfaces of 
the polyhedron are orthogonal to each other. 

[0029] In detail, the images are displayed by fully using a space which is not 
basically suitable for image display. For example, a corner of a room whose indoor walls are 
orthogonal to each other, or at least two adjacent orthogonal inner walls of a box. Here, at 
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least two display surfaces orthogonal to each other include combinations of vertical display 
surfaces and horizontal display surfaces. 

[0030] Accordingly, realistic images are displayed on small display surfaces by 
obtaining a wide viewing angle range and a cubic effect. For example, when the images are 
displayed by using a plurality of adjacent walls of a small room, a person inside the room sees 
the cubic images on the walls with a viewing angle range from a specific viewpoint. Thus, 
he/she feels like being in a real space. 

[0031] In order to display the images on the plurality of display surfaces, display 
screens of image display devices (for example, liquid crystal display device or CRT display 
device) having an image display function are used as display screens. Accordingly, the 
images can be displayed on the plurality of display surfaces by using the display screens of 
the image display devices without requiring a special projection device. 

[0032] As a result, the images can be displayed in a narrow space in which a 
portable box or a projector cannot be provided. 

[0033] In addition, in order to display the images on the plurality of display 
surfaces, image projection surfaces are used as display surfaces, and at least one image 
projection device for projecting the images on the image projection surfaces is used. That is, 
the images are displayed on the plurality of display surfaces by at least one image projection 
device. Accordingly, the images can be displayed in a wider space, which is suitable for a 
store advertisement. Moreover, the images can be displayed on a plurality of display surfaces 
by using one projection device. The projection devices can also be provided respectively on 
the corresponding display surfaces. 

[0034] When the images are displayed on the plurality of display surfaces by using 
one projection device, they must be processed in considering distortion. Nevertheless, using 
one projection device is very advantageous in view of cost of equipment. On the other hand, 
when a plurality of projection devices are used, the cost of equipment increases. However, 
the image processing relating to distortion is not required, which simplifies the process. 

[0035] The polyhedron is formed in a box shape. The inner surfaces of the box are 
used as display surfaces. An inner viewing window for viewing the inside of the box is 
provided in the box. The specific viewpoint is set on the inner viewing window. 
Accordingly, the user can see the inner display surfaces from the specific viewpoint through 
the inner viewing window. If the box is portable such that the user can carry the box and sees 
the inside of the box from a predetermined time, he/she can see the cubic images at a wide 
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viewing angle range. Therefore, the user feels like being in a real space. Various applications 
of the image display device such as a portable game set are expected. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0036] Fig. 1 is a schematic illustrating a state where real images are displayed on a 
screen in accordance with a first exemplary embodiment of the present invention; 

[0037] Fig. 2 is a schematic illustrating a state of a display unit having three 
orthogonal display surfaces overlapping each other on the screen of Fig. 1; 

[0038] Fig. 3 is a schematic illustrating a state where the images displayed on the 
screen when seen from a specific viewpoint are mapped to the three orthogonal display 
surfaces; 

[0039] Fig. 4 is a schematic illustrating an image view when the images mapped on 
the three orthogonal display surfaces of Fig. 3 are seen from the specific viewpoint; 

[0040] Fig. 5 is a schematic illustrating an image display device in accordance with 
the first exemplary embodiment of the present invention; 

[0041] Fig. 6 is a schematic illustrating 3 DCG images used for explaining a second 
exemplary embodiment displayed on two-dimensional display surfaces by using a two-point 
perspective method; 

[0042] Fig. 7 is a schematic illustrating a state where the images of Fig. 6 are 
divided into two equal parts (along the dashed lines of Fig. 6) and the right and left side 
images are respectively displayed on plane surfaces by using a one-point perspective method; 

[0043] Fig. 8 is a schematic illustrating a state wherein the right and left side images 
of Fig. 7 are connected and displayed on one plane surface; 

[0044] Fig. 9 is an explanatory schematic illustrating how the image is seen in a 
state where the plane images of Fig. 8 are inwardly folded at 90° in the connection part of the 
two images, and the viewpoint is set on a horizontal line connecting two vanishing points and 
approaching the connection part of the two images; 

[0045] Fig. 10 is a schematic illustrating a structure of an image display device in 
accordance with a second exemplary embodiment of the present invention; 

[0046] Fig. 1 1 is an exemplary schematic illustrating an example of projecting the 
images on two orthogonal inner walls by using one projector as a specific example of 
displaying images on the display surface of polyhedron used in the present invention; 
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[0047] Fig. 12 is an explanatory schematic illustrating an example of projecting the 
images on two orthogonal inner walls by using two projectors as a specific example of 
displaying the images on the display surfaces of the polyhedron used in the present invention; 

[0048] Fig. 13 is an explanatory schematic illustrating an example of projecting the 
images on three orthogonal inner walls by using one projector as a specific example of 
displaying the images on the display surfaces of the polyhedron used in the present invention; 

[0049] Fig. 14 is an explanatory schematic illustrating an example of projecting the 
images on three orthogonal inner walls by using three projectors as a specific example of 
displaying of the images on the display surfaces of the polyhedron used in the present 
invention; 

[0050] Fig. 15 is an explanatory schematic of an image display device using three 
orthogonal display surfaces inside a cube; 

[0051] Fig. 16 is an explanatory schematic illustrating the three display surfaces 
orthogonal each other in the cube of Fig. 15 on three-directional coordinates; 

[0052] Fig. 17 is a development schematic illustrating an image displayed on the 
three orthogonal display surfaces of the cube of Fig. 15; 

[0053] Fig. 18 is a schematic illustrating images seen from coordinates (1, 1, 1) of 
the cube of Fig. 16, namely an intersection point of the three horizontal and vertical sides 
extended on an inner viewing window; 

[0054] Fig. 19 is an explanatory schematic illustrating a state where an inner 
viewing window is provided in one surface of the cube, and images are displayed on the five 
display surfaces other than the surface where the inner viewing window is provided to have 
one vanishing point on each display surface; 

[0055] Fig. 20 is a development schematic illustrating display of images on the five 
display surfaces of the cube of Fig. 19; 

[0056] Fig. 21 is an exemplary schematic illustrating an image view when the inside 
of the cube of Fig. 19 is seen from various viewpoints, by setting the viewpoint at the center 
and higher than a certain upper end of the cube; 

[0057] Fig. 22 is a schematic illustrating the inside of the cube when the cube of 
Fig. 21 is slightly rotated in the left directions and the viewpoint is approaching the inner 
viewing window further than Fig. 21 ; 

[0058] Fig. 23 is a schematic illustrating the inside of the cube when the viewpoint 
is approaching the inner viewing window further than Fig. 22; 
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[0059] Fig. 24 is a schematic illustrating the inside of the cube when the cube of 
Fig. 23 is slightly rotated in the left direction. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[0060] Exemplary embodiments of the present invention are explained below. 
These exemplary embodiments include explanations of both the image display method and 
image display device. 

[0061] In accordance with the present invention, images are displayed on a plurality 
of display surfaces which are inner surfaces of a polyhedron. A computer calculates how the 
images will be displayed on each display surface when seen from a specific viewpoint. Thus, 
it is possible to display the obtained images on each display surface with a wide viewing 
angle range, a cubic effect, actuality, and reality. 

[0062] A first embodiment shows a case of displaying real images stored in for 
example, DVDs (Digital Video Disc), and a second embodiment shows a case of displaying 
three-dimensional computer graphic (hereinafter "3 DCG") images. 

[0063] First, display of the real images are described below. Fig. 1 is a schematic 
illustrating a state an image 2 (herein, the image is a triangle) displayed on a large plane 
screen 1. Herein, the image 2 displayed on the screen 1 is seen from a viewpoint PI 
indicating the image 2 as V (PI is positioned away from the surface of the screen 1 at a 
certain distance). 

[0064] A case that the same view as that of seeing the image 2 displayed on the 
screen 1 from the viewpoint PI is applied to a small display unit will now be described. In 
the first exemplary embodiment, a display unit (a display unit including three orthogonal 
display surfaces) 10 of a polyhedron is used as a small display unit. 

[0065] As illustrated in Fig. 2, the display unit 10 includes three orthogonal display 
surfaces with two orthogonal squares 1 1 and 12 forming vertical surfaces, and one square 13 
being provided at the lower end of the two squares and forming a horizontal plane. Inner 
surfaces 11a, 12a, and 13a of the squares 1 1, 12, and 13 are used as display surfaces 
(hereinafter "display surfaces 11a, 12a, and 13a"). 

[0066] The image 2 is displayed on the display surfaces 11a, 12a, and 13a of the 
display unit 10 so that the image 2 is seen as the image 2 displayed on the screen 1 from the 
viewpoint PI of Fig. 1. In addition, projection surfaces, such as screens, or image display 
surfaces of image display devices having an image display function (for example, a liquid 
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crystal display device, a CRT display device, etc.) can be used as the display surfaces 11a, 
12a, and 13a. 

[0067] The technique of displaying the image 2 on the display unit 10 as the 
image 2 displayed on the screen 1 from the viewpoint PI of Fig. 1 can be accomplished by 
using general image transformation techniques such as texture mapping or ray tracing. 

[0068] Fig. 3 is an exemplary schematic illustrating mapping of the image 2, 
displayed on the back large screen 1, to the small display unit 10 positioned in front of the 
screen 1, when the user sees the image 2 from the viewpoint PI. Briefly, the viewpoint PI is 
connected to each apex of the triangle image 2 on the screen 1 (Fig. 3 shows a line connecting 
the three fixed points of the triangle image to the viewpoint PI as a dotted line). Intersection 
points with the display surfaces 11a, 12a, and 13a of the display unit 10 are calculated, and 
image data of each intersection point is calculated to obtain images to be displayed on the 
display unit 10. 

[0069] As described above, the image can be displayed on the small display unit 10 
to have a viewing angle range identical to the large screen 1 when seen from the viewpoint 
PI, by transforming the image from the large screen 1 to the front small display unit 10. 

[0070] Referring to Fig. 3, an image 2' indicated by a bold line, is the image 
displayed on the display unit 10. In addition, the triangle image 2 displayed on the screen 1 
looks like a square due to line distortion on the boundary line between the display surfaces 
11a and 13a and the boundary line between the display surfaces 12a and 13a. However, as 
shown in Fig. 4, when seen from the viewpoint PI, the image T displayed on each display 
surfaces 11a, 12a, and 13a, is identical to the outside triangle image on the display unit 10, 
namely the image 2 displayed on the screen 1 . 

[0071] Fig. 5 is a schematic illustrating construction elements required for 
embodying the first embodiment, such as image transforming device 21 for transforming 
image signals which are objects to be transformed, and image display device 22 for displaying 
the transformed images. 

[0072] The image transforming device 21 transforms an image, namely maps the 
image 2 displayed on the screen 1, onto each of the display surfaces 11a, 12a, and 13a of the 
display unit 10 so that the image 2 seen on the display unit 10, is identical to the image 2 
displayed on the screen 1 from the viewpoint PI of Fig. 1 . Accordingly, the image 2 on the 
screen 1 of Fig. 1 is transformed into the image 2\ indicated by the bold line of Fig. 4, on 
each of the display surfaces 11a, 12a, and 13a of the display unit 10. 
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[0073] The image display device 22 displays the image transformed by the image 
transforming device 21 onto the display surfaces 1 la, 12a, and 13a. For example, when the 
display surfaces 11a, 12a, and 13a are screens, a projection device such as a projector is used 
as the image display device 22. If the display surfaces 1 la, 12a, and 13a are liquid crystal 
screens, a liquid crystal display device is used as the image display device 22. If the display 
surfaces 1 la, 12a, and 13a are CRT screens, a CRT display device is used as the image 
display device 22. That is, various image display devices can be used. 

[0074] According to the first exemplary embodiment, the image T is transformed on 
the polyhedron display unit 10 using the inner surfaces of the three orthogonal squares 11,12, 
and 13 as the display surfaces 1 la, 12a, and 13a, so that the image 2' is identical to the 
image 2 displayed on the large screen 1 viewed from the predetermined viewpoint PL When 
viewing the display unit 10 from the viewpoint PI, the image 2', displayed on the display 
unit 1 0, can have a wide viewing angle range like the image displayed on the large screen 1 
even though the display unit 10 is small. Thus it is possible to display realistic images. 

[0075] The second exemplary embodiment of realistically displaying the 3 DCG 
images will now be explained. 

[0076] Similar to the first exemplary embodiment, the second exemplary 
embodiment uses the display unit 10 having the three orthogonal display surfaces 1 la, 12a, 
and 13a. 

[0077] Herein, in consideration of displaying the 3 DCG images on the display unit 
10, as shown in Fig. 6, two rectangular parallelepipeds (first rectangular parallelepiped 3 1 and 
second rectangular parallelepiped 32) are displayed on one plane screen 1 according to a two- 
points perspective method. Vanishing points Al and A2 exist in the right and left sides of the 
screen in the horizontal direction. 

[0078] A processing in which such images are displayed on the display unit 10 will 
now be described. In the second exemplary embodiment, the images displayed on one plane 
screen 1 of Fig. 6, according to the two-point perspective method, can be displayed on a small 
display unit (display unit 10) with a wide viewing angle range and a cubic effect. Even if a 
viewpoint of the user changes, the images can be displayed in natural perspective without 
revealing any incongruity. Herein, an example where images are displayed on the two 
vertical display surfaces 1 la and 12a of the three orthogonal display surfaces 11a, 12a, and 
13a of the display unit 10 is explained. 
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[0079] When the images displayed on one plane screen 1 by using the two-point 
perspective method (refer to Fig. 6) are displayed on the small display unit 10, the following 
processes are performed to display the images with the wide viewing angle range, cubic effect 
and natural perspective without any incongruity regardless of the viewpoint of the user. 

[0080] Fig. 7 is a schematic illustrating a state where one plane screen 1 of Fig. 6 is 
divided into two equal parts in the right and left direction (along the dashed line of Fig. 6). A 
first rectangular parallelepiped 3 1L and a second rectangular parallelepiped 32L, existing on 
the left screen 1L, and a first rectangular parallelepiped 31R and a second rectangular 
parallelepiped 32R, existing on the right screen 1R, are displayed on the screens 1L and 1R 
by using the one-point perspective method. 

[0081] Referring to Fig. 7, the first rectangular parallelepiped 31L and the second 
rectangular parallelepiped 32L, existing on the left screen 1L, are displayed on the display 
surface 1 la of the display unit 10, and the first rectangular parallelepiped 3 1R and the second 
rectangular parallelepiped 32R, existing on the right screen 1R, are displayed on the display 
surface 1 lb of the display unit 10. 

[0082] When the first rectangular parallelepiped 31L and the second rectangular 
parallelepiped 32L are displayed on the left screen 1L, by using the one-point perspective 
method, the second rectangular parallelepiped 32L is displayed almost identically to the left, 
from the dashed line of Fig. 6. But sides LI and L2, extending from two front corner units CI 
and C2 of the first rectangular parallelepiped 31L to the right direction, are displayed as lines 
extending in the horizontal direction, as shown in Fig. 7. 

[0083] On the other hand, the first rectangular parallelepiped 3 1R and the second 
rectangular parallelepiped 32R are displayed on the left screen 1R by using the one-point 
perspective method. The first rectangular parallelepiped 3 1R has a slight difference in line 
gradient, but is displayed almost identically to the right side from the dashed line of Fig. 6. A 
side L3, extending from a corner unit C3 of the second rectangular parallelepiped 32R to the 
left direction, is displayed as a line extended in the horizontal direction. 

[0084] As described above, the images displayed on one screen 1 of Fig. 6 by using 
the two-points perspective method are divided into two equal parts in the right and left 
direction (along the dashed line of Fig. 6). The right and left images are displayed on the 
right and left screens 1R and 1L by using one-point perspective method to obtain the images 
of Fig. 7. 
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[0085] As illustrated in Fig. 8, the two images displayed on the right and left 
screens 1R and 1L of Fig. 7, by using the one-point perspective method, are simply connected 
and displayed on one screen 1 . 

[0086] At first glance, Fig. 8 shows a two-point perspective method. However, 
since the two images displayed by using the one-point perspective method are connected, the 
parts extending in the horizontal direction (parts of LI, L2 and L3) exist in the sides 
composed of the first rectangular parallelepiped 3 1 and the second rectangular parallelepiped 
32 near the dotted line which is a center of the whole display surface of Fig. 8. This is 
incongruent in the two-point perspective method. 

[0087] However, when the plane images of Fig. 8 are inwardly folded at 90 degree 
at the two image joints (dashed line), when the viewpoint is set on the horizontal line 
connecting the two vanishing points Al and A2 and the viewpoint approaches the dashed line 
which is a joint of the two image joints, the images are seen from a certain viewpoint 
identical to the images displayed by using the two-points perspective method as shown in 
Fig. 6. 

[0088] Accordingly, on the two orthogonal display surfaces, 11a and 12a of the 
display unit 10 (as explained in the first exemplary embodiment) of the polygon of the second 
embodiment, the image on the left screen 1L of Fig. 7 is displayed on the display surface 11a. 
The image on the right screen 1R of Fig. 7 is displayed on the display surface 12a. When the 
display surfaces 11a and 12a are seen from a certain viewpoint, the images displayed by using 
the two-points perspective method in Fig. 6 can be seen as shown in Fig. 9. 

[0089] Fig. 9 shows the images displayed on the display surfaces 11a and 12a of the 
display unit 10. The left side image of Fig. 7 is displayed on the left display surface 11a, and 
the right side image of Fig. 7 is displayed on the right display surface 12a. 

[0090] Therefore, when the images are seen in the arrow VI direction, namely 
toward a kinked line of the center of the joint of the two display surfaces 11a and 12a of the 
display unit 1 0, the images are seen identical to the images displayed by using the two-points 
perspective method in Fig. 6. In the case where the images are seen in the arrow V2 
direction, namely toward the left display surface 1 la at an almost right angle, the images are 
seen as images displayed on the left screen 1L of Fig. 7 by using the one-point perspective 
method. When the images are seen in the arrow V3 direction, namely toward the right 
display surface 12a at an almost right angle, the images are seen as images displayed on the 
right screen 1R of Fig. 7 by using the one-point perspective method. 
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[0091] As discussed earlier, when displaying the image displayed by using the two- 
points perspective method in Fig. 6 on the display surfaces (two vertical orthogonal display 
surfaces 11a and 12a) of the display unit 10 composing the polygon, the image displayed by 
using the two-points perspective method in Fig. 6 is divided into two equal parts. The two 
divided images are respectively displayed by using the one-point perspective method (refer to 
Fig. 7), and then displayed on the left and right side orthogonal display surfaces 1 la and 12a. 
In addition, a process for matching the images displayed on the display surfaces 11a and 12a 
is performed. 

[0092] For example, as shown in Fig. 9, even though the viewpoint is toward the 
kinked line of the two orthogonal display surfaces 11a and 12a, to see the two entire display 
surfaces in the arrow VI direction of Fig. 9, or even though the viewpoint is rotated to the 
right and left directions by 45 degrees from the viewpoint position to see the display surfaces 
11a and 12a in the arrow V2 and V3 directions, the images having natural vanishing points 
like a real object can be seen. As a result, the images with the wide viewing angle range and 
a cubic effect can be displayed. Even if the viewpoint of the user changes, the images can be 
displayed with natural perspective without revealing any incongruity. 

[0093] Fig. 10 is a schematic illustrating construction elements of the second 
exemplary embodiment including an image generating device 41 for determining which 
images will be displayed on each display surface according to three-dimensional information 
which is a 3 DCG image, and generating the images to be displayed on the display surfaces, 
and an image display device 22 for displaying the images on each display surface according to 
the image data generated by the image generating device 41 . 

[0094] In detail, the image generating device 41 divides, for example, the images 
displayed by using the two-points perspective method in Fig. 6, displays the images which 
will be displayed on the left display surface 11a and the right display surface 12a of Fig. 9 by 
using the one-point perspective method, and generates images matched with each other by 
connecting the images of the display surfaces 11a and 12a. Here, a general image generation 
technique can be used as an image generating method to generate two-dimensional image data 
from the 3 DCG images. 

[0095] The image display device 22 displays the images generated by the image 
generating device 41 on the right and left display surfaces. For example, when the display 
surfaces 1 la and 12a are screens, a projection device such as a projector is used as the image 
display device 22. When the display surfaces 11a and 12a are liquid crystal screens, a liquid 



14 

crystal display device is used as the image display device 22. When the display surfaces 11a 
and 12a are CRT display screens, a CRT display device is used as the image display device 
22. That is, the image-generating is varied depending on image display device. 

[0096] The second exemplary embodiment shows applications of the present 
invention to the 3 DCG images. The 3 DCG image data has three-dimensional coordinates 
indicating which image data is stored in the computer. As explained above, the image 
generating device 41 calculates which image will be preferably displayed on which display 
surface according to the three-dimensional image data, and displays the obtained images on 
each display surface. 

[0097] The process for displaying the real images of the DVD (the first exemplary 
embodiment) and the 3 DCG images (the second exemplary embodiment) on the small 
display unit 10 having the plurality of display surfaces with actuality or reality was explained 
above. The image display method will be described in detail. 

[0098] Referring to Fig. 1 1 , images are displayed on two orthogonal inwardly 
exposed walls (inner walls) 5 1 and 52 of the four inner walls of a conference room, by setting 
an orthogonal part of the inner walls 51 and 52, namely a joint 53 of the inner walls 51 and 
52, as a center line of a projection screen by using one projector 501 . 

[0099] That is, the image displayed on the left inner wall 5 1 (for example, image 
displayed on the left display surface 11a of Fig. 9) and the image displayed on the right inner 
wall 52 (for example, image displayed on the right display surface 12a of Fig. 9) are 
generated and projected by using one projector 501. 

[0100] In this case, the image displayed on the left inner wall 51 is the image 
displayed on the left display surface 11a of Fig. 9. The image displayed on the right inner 
wall 52 is the image displayed on the right display surface 12a of Fig. 9. The images are 
projected after adjusting their boundary line to the joint 53 of the left and right inner walls 5 1 
and 52 by guide marking so that the projecting person can see the joint. 

[0101] The image generating device 41 of Fig. 10 generates the image displayed on 
the left inner wall 51 and the image displayed on the right inner wall 52. In addition, when 
the images are projected on the two inner walls 51 and 52 forming a certain angle (for 
example, 90°) by using one projector as shown in Fig. 11, the images projected on the inner 
walls 51 and 52 are distorted to form a trapezoid. Accordingly, the image generating device 
41 determines which images are suitable for the left inner wall 5 1 and the right inner wall 52 
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in consideration of the distortion. Moreover, a general image generation technique can be 
used as the image generation process. 

[0102] Identical to Fig. 1 1, in Fig. 12, a joint of two orthogonal inner walls of a 
conference room is set as a center of a projection screen. The image on the left display 
surface 11a of Fig. 9 is displayed on the left inner wall 51 of the joint. The image on the right 
display surface 12a of Fig. 9 is displayed on the right inner wall 52 of the joint. However, as 
shown in Fig. 12, the images are displayed on the left and right inner walls 51 and 52 by using 
two projectors 501 and 502. Here, the projector 501 displays the image on the left inner wall 
51, and the projector 502 displays the image on the right inner wall 52. 

[0103] In Figs. 1 1 and 12, when the viewpoint is positioned toward the joint of the 
two inner walls 51 and 52, or the whole image displayed on the inner walls 51 and 52 is seen, 
or rotated to the right and left directions by 45 degrees from the viewpoint position to see the 
display surfaces in the orthogonal direction, the images having natural vanishing points like a 
real object can be seen. As a result, the cubic images having a wide viewing angle range are 
displayed on the small display screen and appear realistic. 

[0104] In addition, when the images are displayed by using the one projector 501, 
the image generation process must be performed in consideration of distortion. However, it is 
sufficiently advantageous to use only one projector. On the other hand, when two projectors 
502 and 503 are used, the images can be projected to form an optical axis positioned in the 
orthogonal direction to each of the inner walls 51 and 52. Accordingly, the image generating 
device 41 can perform a simple image generation process without considering distortion. 

[0105] The process for projecting the images by using one or more projectors on the 
two orthogonal inner walls 51 and 52 was explained with reference to Figs. 1 1 and 12. 
However, in the same manner, the images can be projected on three orthogonal inner walls by 
using one or more projector. 

[0106] Figs. 13 and 14 show examples of displaying the images on the three inner 
walls. As illustrated in Fig. 13, images are projected on the two orthogonal inner walls 51 

Q 

and 52 and on a horizontal inner wall, (ceiling surface 53) orthogonal to the inner walls 51 
and 52, by using one projector 501 . In this case, guide marking is performed to recognize the 
center of the projection surface from the projector 501. When the images are projected, the 
center is positioned on an intersection point Ol of the joint of the three inner walls 51, 52 and 
53. 
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[0107] In the case where the images are projected by using one projector 501, the 
shape of the projection surfaces of the inner walls 51, 52 and 53 becomes distorted. 
However, the outline of the entire projection surfaces can be formed in an elliptical shape, 
and the outside thereof can be darkened. 

[0108] As depicted in Fig. 14, images are projected on the two orthogonal inner 
walls 51 and 52 and a horizontal inner wall, (referred to as floor surface 54 in this 
embodiment) orthogonal to the inner walls 51 and 52, by using three projectors 501, 502 and 
503. In this case, the projector 501 projects the image displayed on the left side wall 51. The 
projector 502 projects the image displayed on the right side wall 52. The projector 503 
projects the image displayed on the floor surface 54. The images are displayed on the three 
inner walls 51, 52 and 54 by using the three projectors 501, 502 and 503. 

[0109] As described above, since the images are projected by using the three 
orthogonal inner walls, the images having vanishing points can be displayed on each inner 
wall. As a result, the cubic images having wide viewing angle ranges are displayed on the 
small display surfaces and appear realistic. 

[0110] The process for displaying the images on the two orthogonal inner walls 5 1 
and 52, or three orthogonal inner walls 51, 52 and 53, or three orthogonal inner walls 51, 52 
and 54, by using one or more projector was explained above. Instead of using projectors, the 
inner walls 51, 52, 53 and 54 can be formed as display surfaces displaying images (for 
example, liquid crystal display surface or CRT display surface), so that the images can be 
displayed on the liquid crystal display screens or CRT display screens. In addition, when the 
images are projected by the projectors, screens can be used as the projection surfaces instead 
of the inner walls. 

[0111] As an application example of the image display method using three 
orthogonal display surfaces (inner walls of the conference room in the above embodiments), 
images can be displayed by using three inside orthogonal surfaces of a cube 60 shown in Fig. 
15 as display surfaces. 

[0112] In consideration of the three-dimensional coordinates of x, y and z of 
Fig. 16, the cube 60 of Fig. 15 uses an inner wall 61 on an yz-plane surrounded by 
coordinates (0, 0, 0), (0, 1, 0), (0, 1, 1) and (0, 0, 1), an inner wall 62 on an xy-plane 
surrounded by coordinates (0, 0, 0), (0, 1, 0), (1, 1,0) and (1,0, 0), and an inner wall 63 on an 
xz-plane surrounded by coordinates (0, 0, 0), (1, 0, 0), (1, 0, 1) and (0, 0, 1) as three display 
surfaces (hereinafter, referred to as display surfaces 61, 62, 63). In regard to the images 
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displayed on the three display surfaces 61, 62 and 63, the coordinates (1, 1, 1) is set as the 
viewpoint PI, and the inside of the cube 60 is seen from the viewpoint PI . 

[0113] As shown in Fig. 15, a periphery of cube 60 is notched to form a triangle at 
the coordinates (1, 1, 1). The notched part is determined as an inner viewing window 60a for 
viewing the inside of the cube 60, and the coordinates (1, 1, 1) of the inner viewing window 
60a are set as a viewpoint PI, so that the inside of the cube 60 can be seen from the viewpoint 
PI . The inner viewing window 60a need not to be a triangle. It can be in a circular or 
elliptical shape. 

[0114] The images are displayed on the three inner display surfaces 61, 62 and 63 of 
the cube 60 to respectively have one vanishing point by using the one-point perspective 
method. The vanishing points are the coordinates (0, 1, 1) of the display surface 61, the 
coordinates (1, 1, 0) of the display surface 62 and the coordinates (1,0, 1) of the display 
surface 63. 

[0115] A process for displaying one cube 70 as images by using the three display 
surfaces 61, 62 and 63 will now be explained. 

[0116] Fig. 17 is a development schematic illustrating the three orthogonal display 
surfaces 61, 62 and 63 of Fig. 15. Sides of the cube 70 as images are displayed on each of the " 
display surfaces 61, 62 and 63 as images by using the one-point perspective method. As 
described above, the vanishing point Al of the display surface 61 is represented by the 
coordinates (0, 1,1). The vanishing point A2 of the display surface 62 is represented by the 
coordinates (1,1, 0). The vanishing point A3 of the display surface 63 is represented by the 
coordinates (1,0, 1). 

[0117] As described above, with regard to the images displayed on the display 
surfaces 61, 62, and 63, the computer can calculate which images are suitable for the 
respective display surfaces 61, 62 and 63, when given the information on coordinates, 
positions of vanishing points or perspective methods. In this case, the images are displayed 
on each of the display surfaces 61, 62 and 63 as shown in Fig. 17. 

[0118] Referring to Fig. 17, when lines indicating the joints of the display surfaces 
61, 62 and 63 (the lines are represented by x, y and z lines, x line corresponds to x axis of Fig. 
16, y line corresponds to y axis of Fig. 16, and z line corresponds to z axis of Fig. 16) are 
folded at 90 degrees, and when the z line of the display surface 61 and the z line of the display 
surface 63 overlap with the display surface 63 by an overlap unit formed on the display 
surface 61 to make the Z line commonly used therebetween, the three inner orthogonal 
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display surfaces 61, 62 and 63 of the cube 60 of Fig. 15 are formed. When the inside of the 
cube 60 is seen from the coordinates (1, 1, 1) of the cube 60, namely the viewpoint PI of the 
inner viewing window 60a, the images (in this case, cube 70) displayed by using the three- 
point perspective method are seen on the three orthogonal display surfaces 61, 62 and 63 as 
shown in Fig. 18. 

[0119] That is, the cube 70 includes vanishing points on each of the display surfaces 
61, 62 and 63 (vanishing point Al on the display surface 61, vanishing point A2 on the 
display surface 62, and vanishing point A3 on the display surface 63). When the three display 
surfaces 61, 62 and 63 are seen from the coordinates (1, 1, 1) which indicate the viewpoint PI 
of the inner viewing window 60a, the cubic images having wide viewing angle ranges are 
seen with the vanishing points Al, A2 and A3 in the right and left direction and downward 
direction. In addition, when the display surfaces 61, 62 and 63 are individually seen, the 
images having vanishing points in natural directions appear realistic. 

[0120] As described above, the images are displayed to have vanishing points Al, 
A2 and A3 on the three display surface 61, 62, and 63 respectively, by using the three 
orthogonal display surfaces 61, 62 and 63. However, it is possible to increase the number of 
display surfaces. For example, as shown in Fig. 19, an inner viewing window 80a is provided 
on one surface 86 of a cube 80. Five inner surfaces, except for the surface 86, in which the 
inner viewing window 80a present, are used as display surfaces 81, 82, 83, 84 and 85. Images 
are displayed to have one vanishing point on each of the display surfaces 81, 82, 83, 84 and 
85 respectively. 

[0121] Fig. 20 is a development schematic illustrating the images displayed on the 
five display surfaces 81, 82, 83, 84 and 85 of the cube 80 of Fig. 19, showing the examples of 
the images displayed on each of the display surfaces 81, 82, 83, 84 and 85. As shown in 
Fig. 20, the five display surfaces 81, 82, 83, 84 and 85 respectively have vanishing points. 

[0122] Still referring to Fig. 20, the joints of the adjacent display surfaces 81, 82, 
83, 84 and 85 are folded at 90 degrees to form the cube of Fig. 19. The user carries the cube 
80 with his/her hands, and sees the inside of the cube 80 from the viewpoint set on the inner 
viewing window 80a provided on the upper surface (viewpoint is a center of the inner 
viewing window 80a on the same plane as the upper end of the cube). Accordingly, 
geometrical shapes 91, 92, 93 and 94 extending in the east, west, south and north directions, 
are displayed on each of the display surfaces 81, 82, 83, 84 and 85 with appropriate 
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perspective. In addition, a geometrical shape 95 displayed on the bottom surface (display 
surface 85) shows appropriate perspective in the up/down direction. 

[0123] Figs. 21 to 24 illustrate an example of a view when the user carries the cube 
80 with his/her hands and sees the inside of the cube 80 from the inner viewing window 80a, 
namely when a position of the viewpoint variously changes. 

[0124] As depicted in Fig. 21, the viewpoint is set at the center and higher than an 
upper side 84a of the display surface 84 of the cube 80 (refer to Figs. 19 and 20), and the 
inside of the cube 80 is seen from the inner viewing window 80a. The geometric shape 92 
displayed on the display surface 82 is shown as if it was extended in the viewpoint direction. 

[0125] As shown in Fig. 22, when the cube 80 is slightly rotated in the left direction 
from the state of Fig. 21 and a viewpoint approaches the inner viewing window 80a more 
than that of Fig. 21, the inside of the cube 80 is seen from the inner viewing window 80a. 
The geometric shape 92 displayed on the display surface 82 is shown as if it was extended in 
the upper left direction from the viewpoint direction, and the geometric shape 93 displayed on 
the display surface 83 is partially seen. 

[0126] As illustrated in Fig. 23, when the viewpoint approaches the inner viewing 
window 80a more than that of Fig. 22, the inside of the cube 80 is seen from the inner 
viewing window 80a. The geometric shape 92 displayed on the display surface 82 is shown 
as if it was extended further in the depth direction than that of Fig. 22. 

[0127] Referring to Fig. 24, when the cube 80 is slightly rotated in the left direction 
from the state of Fig. 23, the inside of the cube 80 is seen. The geometric shape 92 displayed 
on the display surface 82 and the geometric shape 93 displayed on the displays surface 83 are 
shown as if they extended in the upper right and left directions at about 45 degree from the 
viewpoint direction. 

[0128] As described above, when the images are displayed to have one vanishing 
point on each of the plural display surfaces (in the above embodiment, five display surfaces 
81, 82, 83, 84 and 85), two or three orthogonal display surfaces are used. However, liquid 
crystal screens or CRT display screens can be used as display surfaces. In this case, images 
can be projected on each display surface by using a projector. 

[0129] In addition, the cube 80 having the plurality of display surfaces (in the above 
embodiment, five display surfaces) can be large enough for the user to enter. When the user 
enters the cube 80, if the images of Fig. 19 are projected on the five inner walls (five display 
surfaces 81, 82, 83, 84 and 85) by using, for example, five projectors, the user sees the display 
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surfaces 81, 82, 83, 84 and 85 from the predetermined viewpoint. Therefore, the user can feel 
like being in a real object. 

[0130] When the cube 80 is portable, the user sees the inside of the cube 80 from 
the viewpoint set on the inner viewing window 80a. Herein, the images having the wide 
viewing angle range and a cubic effect are displayed. Therefore, the user can feel like being 
in a real scene. Various applications of the image display device such as a portable game set 
are expected. 

[0131] Although the preferred exemplary embodiments of the present invention 
have been described, it is understood that the present invention should not be limited to these 
preferred exemplary embodiments and that various changes and modifications can be made 
by one skilled in the art within the spirit and scope of the present invention as hereinafter 
claimed. For example, in the above exemplary embodiments, the plurality of display surfaces 
displaying images are orthogonal display surfaces. However, surfaces having an angle less 
than 180 degrees between each other can be freely used. Curved surfaces can also be used. 

[0132] In accordance with the present invention, a processing program including a 
processing order of the invention can be prepared and recorded on a recording medium such 
as a floppy disk, an optical disk and a hard disk. The present invention includes the recording 
medium on which the processing program has been recorded. The processing program can be 
obtained from a network. 
[Advantages] 

[0133] As discussed earlier, in accordance with the present invention, the image 
display method for displaying images on the plurality of display surfaces, which are inner 
surfaces of the polyhedron, calculates how the images will be displayed on each display 
surface when seen from a specific viewpoint, and displays the obtained images on each 
display surface. Accordingly, the images having a wide viewing angle range and a cubic 
effect with actuality or reality thereto can be displayed even on the small display surfaces. 

[0134] The real images, such as DVD will have the wide viewing angle range and a 
cubic effect providing actuality or reality thereto and be displayed even on the small display 
surfaces. In addition, the three-dimensional computer graphic images will be displayed with 
natural vanishing points like a real object on the small display surfaces. As a result, the 
images are displayed with the wide viewing angle range and a cubic effect. Even if the 
viewpoint of the user changes, the images are displayed with natural perspective without 
revealing any incongruity. 
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[0135] The examples in which plurality of inner surfaces of the polyhedron are used 
as display surfaces include the use of the space which is not suitable for image display such as 
corners of a room whose indoor walls are orthogonal (including ceiling and floor), or at least 
two adjacent inner walls of a box like a cube. Therefore, when the images are displayed on 
the plurality of walls of a small room, a person inside the room can see the images displayed 
on the walls with a wide viewing angle range and a cubic effect from a specific viewpoint. 
Thus, he/she feels like being in a real space. 

[0136] In addition, the polyhedron is in a shape of box. The inner surfaces of the 
box are used as display surfaces. The inner viewing window is provided in the box. The 
specific viewpoint is set on the inner viewing window. Accordingly, the user can see the 
inner display surfaces from the viewpoint through the inner viewing window. Moreover, if 
the box is portable such that the user carries and sees the inside of the box from a 
predetermined viewpoint, he/she can see the cubic images in the wide viewing angle range. 
Accordingly, the user feels like being in a real space. Various applications of the image 
display device such as a portable game set are expected. 



